NORMAL FORMS OF CONVEX LATTICE POLYTOPES 
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Abstract. We describe an algorithm for determining whether two convex polytopes P and Q, 
embedded in a lattice, are isomorphic with respect to a lattice automorphism. We extend this 
to a method for determining if P and Q are equivalent, i.e. whether there exists an affine lattice 
automorphism that sends P to Q. Methods for calculating the automorphism group and affine 
automorphism group of P are also described. 

An alternative strategy is to determine a normal form such that P and Q are isomorphic if 
and only if their normal forms are equal. This is the approach adopted by Kreuzer and Skarke 
in their Palp software. We describe the Kreuzer-Skarke method in detail, and give an improved 
algorithm when P has many symmetries. Numerous examples, plus two appendices containing 
detailed pseudo-code, should help with any future reimplementations of these techniques. We 
conclude by explaining how to define and calculate the normal form of a Laurent polynomial. 



1. Introduction 

Determining whether two convex polytopes P and Q, embedded in a lattice A, are isomorphic 
with respect to a lattice automorphism is a fundamental computational problem. For example, 
in toric geometry lattice polytopes form one of the key constructions of projective toric varieties, 
and any classification must somehow address the issue of whether there exists an automorphism 
of the underlying lattice sending P to Q. In general, any isomorphism problem can be solved in 
one of two ways: on a case-by-case basis by constructing an explicit isomorphism between the 
two objects, or by determining a normal form for each isomorphism class. 

The first approach - dynamically constructing a lattice- preserving isomorphism in GL„(Z) 
between the two polytopes ~ is discussed in ^ We describe one possible way to determine 



isomorphism of polytopes via the labelled face graph W{P) (see ^2.1). This has the advantage 
that it works equally well for rational polytopes and for polytopes of non-zero codimension. By 
reducing the problem to a graph isomorphism question, well-developed tools such as Brendan 
McKay's Nauty software |McK81[ IMcKj can then be apphed. 

Because our approach to isomorphism testing works equally well for rational polytopes, we 
are able to answer when two polytopes are equivalent, i.e. when there exists an isomorphism 



B S GLn(Z) and lattice translation c € A such that PB -\- c = Q. This is discussed in i2A We 
can also calculate the automorphism group Aut(P) < GL„(Z) of P: this is a subgroup of the 
automorphism group of ^^(P), as explained in ^2.5[ Since our methods make no assumptions on 
the codimension of P, by considering the automorphism group of P x {1} in A x Z we are able 
to calculate the group of affine automorphisms AffAut(P) < GL„,(Z) x A. As an illustration 
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of our methods, we calculate the order of the automorphism group for each of the 473,800,776 
four-dimensional reflexive polytopes |KS00j : see Table [ij 

The second approach - to compute a normal form NF(P) for each isomorphism class - is 
discussed in ^ This is the approach adopted by Kreuzer and Skarke in their Palp soft- 
ware |KS04j , and was used to construct the classification of three- and four-dimensional reflexive 
polytopes |KS98| IKSOO] . Briefly, row and column permutations are applied to the vertex-facet 
pairing matrix PM of P, placing it in a form PM™*^^ that is maximal with respect to a certain 
ordering. This in turn defines an order in which to list the vertices of P; the choice of basis is 



fixed by taking the Hermite normal form. In { 3.3 we address how this can be modified to give an 



affine normal form for P, and in ^3.4 we describe how Palp applies an additional reordering of 
the columns of PM™^^ before computing the normal form. The Palp source code for computing 
NF(P) is analyzed in detail in Appendix [A} 

In ^we address the problem of calculating PM™*^. We describe an inductive algorithm which 
attempts to exploit automorphisms of the matrix in order to simplify the calculation; pseudo- 
code is given in Appendix [Bj Applying our algorithm to smooth Fano polytopes [ 0brO7j , which 
often have large numbers of symmetries, illustrates the advantage of this approach: see §4.1| and 
Table [2j We end by giving, in ^ an application of normal form to Laurent polynomials. 

A note on implementation. The algorithms described in ^were implemented using Magma 
in 2008 and officially released as part of Magma V2.16 |BCP971lBBK09j : Palp normal form was 
introduced by Kreuzer and Skarke in their Palp software |KS04j and reimplemented natively 
in Magma V2.18 by the authors. The Magma algorithm^ including the reimplementation of 
Palp normal form, have recently been ported to the Sage project [S"*"] by Samuel Gonsha'wj^ 
assisted by Tom Coates and the second author, and should appear in the 5.6.0 release. 

Acknowledgments. This work was motivated in part by discussions with Max Kreuzer during 
August and September 2010, shortly before his death that November. We are honoured that 
he found the time and energy for these conversations during this period. It forms part of the 
collaborative Palp+-|- project envisioned in |KrelO| . 

Our thanks to Tom Coates for many useful discussions, to Harald Skarke and Dmitrii Pasech- 
nik for several helpful comments on a draft of this paper, to John Cannon for providing copies of 
the computational algebra software Magma, and to Andy Thomas for technical assistance. The 
first author was funded by a Summer Studentship as part of Tom Coates' Royal Society Uni- 
versity Research Fellowship. The second author is supported by EPSRC grant EP/I008128/1. 

2. Isomorphism testing via the page graph 

Conventions. Throughout this section we work with very general convex polytopes; we assume 
only that P C Aq := A (gi Q is a (non-empty) rational convex polytope, not necessarily of 
maximum dimension in the ambient lattice A. The dual lattice IIom(A, Z) is denoted by A*. 



^Users of Magma can freely view and edit the package code. The relevant files are contained in the subdirectory 
package/Geometry/Tor icGeom/polyhedron/. 



Gonshaw's implementation is available from http://trac.sagemath.org/sage_trac/ticket/13525 
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Given two polytopes P and P' , how can we decide whether they are isomorphic and, if they 
are, how can we construct an isomorphism between them? There are, of course, some obvious 
checks that can quickly provide a negative answer. We give a few examples, although this list 
is far from comprehensive. 

• Do the dimensions of the polytopes agree? 

• Does P contain the origin in its relative interior? Is the same true for P'l 

• Are P and P' both lattice polytopes? 

• Are the /-vectors of P and P' equal? 

• Do P and P' have the same number of primitive vertices? 

• Arc P and P' simplicial? Arc they simple? 

• If P is of codimension one then there exists a unique hyperplane H C Aq containing P, 
where H = {v & Aq | (u, u) = k} for some non-negative rational value k and primitive 
dual lattice point G A*. In particular, k is invariant under change of basis. Does k 
agree for both P and P'? 

• If P is of maximum dimension, any facet F can be expressed in the form P = G P | 
{v,uf) = —cp}, where up € A* is a primitive inward-pointing vector normal to P, and 
cp G Q is the lattice height of P over the origin. The value of cp is invariant under 
change of basis. Do the facet heights of P and P' agree, up to permutation? 

• If P is a rational polytope, let rp be the smallest positive integer such that the dilation 
rpP is a lattice polytope. Do rp and rp/ agree? 

Remark 2.1. From a computational point of view, the intention with the above list is to 
suggest tests that are easy to perform. We assume that data such as the vertices and supporting 
hyperplanes of P have already been calculated. Some computations, such as finding the /-vector, 
are more involved, but since the calculations will be required in what follows it seems sensible 
to use them at this stage. 

In practice a number of other invariants may already be cached and could also be used: the 
volume Vol(P) or boundary volume Vol(9P); the number of lattice points |Pn A| or boundary 
lattice points |5PnA|; the Ehrhart 5- vector; information about the polar polyhedron P*. In 
particular cases some of this additional data may be easy to calculate; in general they are usually 
more time-consuming to compute than the isomorphism test described below. 

Remark 2.2. There are a few potential catches for the unwary when considering rational poly- 
topes with dimP < dim A. For example, care needs to be taken when defining the supporting 
hyperplanes. Also, the notion of (normalised) volume Vol(P) requires some attention: the affine 
sublattice aff(P) n A may be empty, forcing us to either accept that Vol(P) can be undefined, 
or to employ interpolation. There is a natural dichotomy between those polytopes whose affine 
span contains the origin and those where ^ aff(P). In the latter case, it is often better to 
consider the cone Cp := cone(P) equipped with an appropriate grading such that dilations of 
P can be realised by taking successive slices through Cp. 



4 



R. GRINIS AND A. M. KASPRZYK 



2.1. The labelled face graph. In order to determine isomorphism we make use of the face 
graph G{P) of P. 

Definition 2.3. Let P be an n-dimensional polytope with /-vector (/-i, /o, • • • , /n)) where 
fk denotes the number of A;-faces of P. By convention we set /_i = fn = 1, representing, 
respectively, the empty set and the polytope P. The face graph G{P) is the graph consisting 
of /_i + /o + . . . + /n vertices, where each vertex v corresponds to a face F^. Two vertices v 
and v' are connected by an edge if and only if F.^/ C F^ and dimF„/ = dimF^, + 1. Here the 
dimension of the empty face is taken to be —1. 

The face graph of a polytope is completely determined by the vertex-facet relations, and 
is the standard tool for determining combinatorial isomorphism of polytopes. We augment 
G{P) by assigning labels to the vertices determined by some invariants of the corresponding 
face. Reducing a symmetry problem to the study of a (labelled) graph is a well-established 
computational technique: see, for example, |KSn3[ |Pug05t IMdlBWOOl lBSP+12j . The intention 



is to decorate the graph with data capturing how P lies in the underlying lattice A. To that 
end, we make the following definition. 

Definition 2.4. For a point v G Aq, let m S A be the unique primitive lattice point such that 
V = Xu for some non-negative value A (set u = 0, A = if f = 0). We define v to be given by 
[A]ii, i.e. V is the first lattice point after or equal to v on the ray defined by v. Let P C Aq 
be a polytope with vertices V{P). Then the index \P : A| of P is the index of the sublattice 
generated hy {u \ u £ V{P)} in span(P) n A. 

Definition 2.5. Let P be an n-dimensional polytope with face graph G{P). To each vertex v 
of G{P) we assign the label 

J (dimF^), if F„ = or F^ = P; 

1 (dim Ft,, \F^ : A|), otherwise. 

We denote this labelled graph by ^(P). 

Remark 2.6. In place of the index |F„ : A|, it is tempting to use the volume Vol(F^). However, 
computing the index is basic linear algebra, whereas computing the volume is generally difficult. 

2.2. Additional labels. When P contains the origin strictly in its interior, we can make use of 
the special facets. Recall from [0brO7l §3.1] that a facet F is said to be special if n E cone(F), 
where u := X^^gv(p) v is the sum of the vertices of P. Since P contains the origin, there exists at 
least one special facet; we can extend the labelling to indicate which vertices of ^{P) correspond 
to a special facet. 

Example 2.7. The polytope P := conv{(l, 0), (0, 1), (-2, -3)} and its labelled face graph <^{P) 
are depicted below. In the graph, the top- most vertex represents P and the bottom vertex 0. 
The sum of the vertices is (—1, —2), so there is a unique special facet: the edge joining vertices 
(1,0) and (—2,-3) of index three, labelled (1,3,1) in ^(P). The edge joining vertices (1,0) 
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and (0, 1) is of index one and labelled (1, 1,0); the remaining edge is of index two and labelled 
(1, 2, 0). The final entry of each facet label is used to indicate whether this is a special facet. 

(0,1) (2) 




(-1) 

If P is a rational polytope, the vertices of P provide an augmentation to the labelling of ^(P). 
For any vertex v G V(P) there exists a primitive lattice point u G A and a non- negative rational 
value A such that v = Xu. Since A is invariant under change of basis, the corresponding labels 
can be extended with this information. (Note that A = |v : A| when w is a lattice point, so this 
only provides additional information in the rational case.) 

We do not claim that these are the only easily-computed invariants that can be associated 
with '^{P). Other possibilities include encoding the linear relations between the vertices V(P) 
of P in the graph labelling, and, in the maximum dimensional case, adding information about 
the lattice height of the supporting hyperplanes for each face. 

2.3. Recovering the isomorphism. We now describe our algorithm for computing an iso- 
morphism between two polytopes P and P' . The initial step is to normalise the polytopes. If 
P and P' are not of maximum dimension in the ambient lattice A, then we first restrict to the 
sublattice span(P)nA (and, respectively, span(P')nA). It is possible that, even after restriction, 
P and P' are of codimension one. In that case, we work with the convex hull conv(P U {0}) (and 
similarly for P'). The important observations are that, after normalisation, P is of maximum 
dimension, and that there exists at least one facet Fq of P such that ^ aff(Po)- 

Now we calculate an arbitrary graph isomorphism : ^(P) — >■ ^(P'). By restricting to the 
vertices of '^{P) corresponding to the vertices V(P) of P, ^ induces a map from the vertices of 
P to the vertices of P'. The two polytopes P and P' are isomorphic only if (j) exists, and any 
isomorphism <I> : A — t- A mapping P to P' can be factored a,s (po where x G Aut(^^(P)). 

It remains to decide whether a particular choice of x £ Aut(^^(P)) determines a lattice 
isomorphism ^ o ;^ : A — )■ A sending P to P'. For this we make use of the facet Fq. By 
construction Fq is of codimension one, and does not lie in a hyperplane containing the origin. 
Hence there exists a choice of vertices v\,...,Vn of Fq which generate Aq (over Q). Denote 
the image of Vi in P' by v'^, and consider the n x n matrices V and V' whose rows are given 
by, respectively, the Vi and the v[. In order for (f> o x to be a lattice map we require that 
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B := V G GL„(Z). In order for this to be an isomorphism from P to P' we require that 
{vB\v(^ V{P)} = V{P'). 

Remark 2.8. We make two brief observations. First, in practice the automorphism group 
Aut(^^(P)) is often smaU. Second, it is an easy exercise in Unear algebra to undo our normah- 
sation process, hfting B back to act on the original polytope. 

2.4. Testing for equivalence. Recall that two polytopes P, P' C Aq are said to be equivalent 
if there exists an isomorphism B G GL„(Z) and a translation c G A such that PB + c = P' . 

Definition 2.9. Let V{P) be the set of vertices of a polytope P. Then the vertex average of P 
is the point 

^^-■=\vlP)\ ^ 

' ^ ^' i>eV{P) 

Two polytopes P and P' are equivalent if and only \i bp — hpi G A and P — hp is isomorphic 
to P' - bp,. 

Example 2.10. Consider the simplices 

P := conv{(0, 0, 0), (2, 1, 1), (1, 2, 1), (1, 1, 2)}, 
P' := conv{(0, 1, 2), (1, 0, 0), (3, 1,4), (4, 2, 6)}. 
The vertex averages are bp = (1, 1, 1) and bp' = (2, 1, 3), and (P — bp)B = P' — bp/, where 

B : = 




Hence P and P' are equivalent. 

2.5. Determining the automorphism group of a polytope. We can use the labelled face 
graph '^{P) to compute the automorphism group Aut(P). We simply use the elements x of 
Aut(^^(P)) to construct Aut(P) < GL„(Z). Notice that there is no requirement that P is 
of maximum dimension in the ambient lattice A. Given this, we can also compute the affine 
automorphism group AffAut(P). Begin by embedding P at height one in the lattice A x Z 
(equivalently, consider the cone Cp spanned by P with appropriate grading). We refer to this 
embedded image of P as P. The action of the automorphism group Aut(P) on P restricts to an 
action on P, realising the full group of affine lattice automorphisms of P. A detailed discussion of 
polyhedral symmetry groups and their applications can be found in |BEK84I IBDSSOQl IBSP+ 12 



Example 2.11. Let P be the three-dimensional simplicial polytope with seven vertices given 
by (±1,0,0), (0,±1,0), (0,0,1), (1,1,0), (0,-1,-1). This is sketched below; the /-vector is 
(1, 7, 15, 10, 1). The index \F : A| of each face F is one (in fact P is a smooth Fano polytop^, 
and P has four special facets (the four facets incident to the vertex (1,0,0)). The resulting 



■^Smooth Fano polytope number 13 in the Graded Ring Database |BK) 
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labelled graph ^{P) has automorphism group of order four, however Aut(P) has order two, and 
is generated by the involution (0, 0, 1) i— (0, —1, —1). 



Example 2.12. The four-dimensional centrally symmetric polytope P with vertices 

± (1, 0, 0, 0), ±(0, 1, 0, 0), ±(0, 0, 1,0), ±(0, 0, 0, 1), 

±(1,-1,0,0), ±(1,0, -1,0), ±(1,0, 0,-1), ±(0,1, -1,0), ±(0,1, 0,-1), 

±(1,0, -1,-1), ±(0,1, -1,-1), ±(1,1, -1,-1) 

is the reflexive realisation of the 24-cell, with /-vector (1, 24, 96, 96, 24, 1). It is unique amongst 
all 473,800,776 reflexive polytopes in having |Aut(P)| = 1152; in fact Aut(P) is isomorphic to 
the Weyl group W{F4). In particular, P must be self-dual. The number of four-dimensional 
reflexive polytopes with |Aut(P)| of given size are recorded in Table [T] 

Example 2.13. Let P = conv{(0, 0), (1, 0), (0, 1)} be the empty simplex in I?. Then Aut(P) is 
of order two, corresponding to reflection in the line x = y. To compute the affine automorphism 
group AffAut(P) of P, we consider P = conv{(0, 0, 1), (1, 0, 1), (0, 1, 1)}. The group Aut(P) is 
of order six, generated by 

-1 0\ /O -1 

-110 and 1-10 
10 1/ VO 1 1 

The first generator corresponds to the involution exchanging the vertices (0,0) and (1,0) of P, 
whilst the second generator corresponds to rotation of P about its barycentre (1/3, 1/3), given 
by 

{x,y)^{x-l/3,y-l/3)^^ ± (1/3, 1/3) = (x, y) 

3. Normal forms 



The method for determining isomorphism adopted by Kreuzer and Skarke in the software 
package Palp |KS04j is to generate a normal form for the polytope P. We shall briefly sketch 
their approach. Their algorithm is described in detail in Appendix [A} 
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Table 1. The number of four-dimensional reflexive polytopes with auto- 
morphism group of size |Aut(P)|. 

Throughout we require that the polytope P C Aq is a lattice polytope of maximum dimension. 
It is essential to the algorithm that the vertices are lattice points; one could dilate a rational 
polytope by a sufficiently large factor to overcome this restriction, but in practice the resulting 
large vertex coefHcients can cause computational problems of their own. Let n denote the 
dimension of P, and be the number of vertices V(P). We can represent P by an tt, x 
matrix V whose columns are given by the vertices. Obviously V is uniquely defined only up to 
permutations a G Sn^ of the columns. 

Given any matrix V with integer entries, we can compute its Hermite normal form H(y). 
This has the property that, for all B G GL„(Z), H{V) = H(y ■ B), however permuting the 
columns of V will result in different Hermite normal forms. Naively one could define the normal 
form NF(P) of P to be 

m.ui{H{aV) | fi G S'„„} , 

where aV denotes the matrix obtained by permuting the columns of V by cr, and the minimum 
is taken with respect to some ordering of the set of n x integer matrices (say, lexicographic 
ordering) . Unfortunately the size of Sn^ is too large for this to be a practical algorithm. 

3.1. The pairing matrix. The key to making this approach tractable is the vertex-facet pair- 
ing matrix. 

Definition 3.1. Let P be a lattice polytope with vertices Vj, and let {wi,Ci) G A* x Z define 
the supporting hyperplanes of P; each Wi is a primitive inward-pointing vector normal to the 
facet Fi of P, such that {wi,v) = —Ci for all v e Fi. The vertex-facet pairing matrix PM is the 
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Uf X matrix with integer coefficients 

PMij := {wi,Vj) + Ci. 

In other words, the zj-th entry of PAI correspond to the lattice height of Vj above the facet 
Fi. This is clearly invariant under the action of GL„(Z). It is also invariant under (lattice) 
translation of P. Permuting the vertices of P corresponds to permuting the columns of PM, 
and permuting the facets of P corresponds to permuting the rows of PM. Thus there is an 
action of 5„^. x Sn^ on PM: given a = {af,ay) G Sn^ x Sn^, 



{(jPM), 



PM, 



There is a corresponding action on V given by restriction: 

aV := a^V. 

Let PAf™^^ denote the maximal matrix (ordered lexicographically) obtained from PM by 
the action of Snj x 5n„ , realised by some clement CTj^ax* 

Let Aut(PM°>^^) < Snf X 5„„ be the 

automorphism group of PM™^^. Then: 

Definition 3.2. The normal form of P is 

NF(P) = mm{H{a o cJmaxl^) | (T G Aut(PM"'^^)} . 

Remark 3.3. Let G be the group generated by the action of Aut(PM) on the columns of PM. 
Then Aut(P) < G. Hence we have an alternative method for constructing the automorphism 
group when P is a lattice polytope of maximum dimension. 

Example 3.4. Consider the three-dimensional polytope P with vertices (1, 0, 0), (0, 1, 0), (0, 0, 1), 
(—1,0,1), (0,1,-1), (0,-1,0), (0,0,-1); P is isomorphic to the polytope in Example 2.11 via 
the change of basis 

^0 -1 -1^ 
1 
^0 -1 

With the vertices in the order written above, and some choice of order for the facets, the vertex- 
facet pairing matrix is given by 

/l 1 
1 1 
1 
2 
1 



PM 



2 
1 
2 
2 
1 
2 
2 
1 







2 3 

2 3 

2 



2 
2 
2 
2 


1 

1 
1 



2 1 



0/ 
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The maximum vertex-facet pairing matrix is 



/3 
3 
1 

1 



2 
2 
2 

2 

1 
1 



2 1 0\ 



2 
3 






2 



2 10 
2 10 



10 3 

10 

12 

yo 1 



1 
2 1 




2 
2 
1 
1 
2 

2/ 



realised by, for example, the permutation ((1 5 2 6)(3 9)(4 10 7 8), (1 4 5)(3 6 7)) of PM. The 
automorphism group of PM^'^^ is of order two, generated by 



((1 2)(3 4)(5 6)(7 8)(9 10), (4 5)). 



We see that NF(P) is equal to 



a 1 0-1-1 



1-10 
^0 1 



1 

-1 




PM" 



corresponding to the sequence of vertices (1, 0, 0), (0, 1, 0), (1, —1, 0), (0, 0, 1), (—1, 1, —1), (— 1, 1, 0), 
and (0, —1, 0). In this example Aut(PM™^) = Aut(NF(P)), and acts by exchanging the vertices 
(0,0,1) and (-1,1,-1). 

Example 3.5. Let P := conv{(-l, -2, -2), (1, 0, 0), (0, 2, 1), (0, 0, 1)} be a three-dimensional 
reflexive polytope. This has 

A o\ 

4 
4 

yo 4y 

with Aut(PM™'") = Si of order 24. However, |Aut(P)| = 8; with ordering as above, the action 
on the vertices is given by the permutation group with generators (1 4 2 3) and (3 4). 

3.2. Lattice polytopes of non-zero codimension. Suppose that P is a lattice polytope such 
that dimP < dim A. We can still define a normal form: how we proceed depends on whether 
G aff(P). 

First suppose that G aff(P), so that aff (P) = span(P). Set d = dim P. We restrict P to the 
sublattice span(P) n A = Z'^ and calculate the normal form there. The result can be embeded 
back into A via 

(ai,...,ad) (0, ...,0,ai,...,ad). 

Now suppose that aff(P). In this case we consider the polytope Pq := conv(P U {0}). The 
normal form NF(Po) can be calculated and then the origin discarded. 
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Example 3.6. Let P := conv{(— 1, 1, 1, 0), (1, 1, 1, 1), (0, 0, 0, —1)} be a lattice polygon of codi- 
mension two. The three-dimensional sublattice span(Po)nZ^ has generators (1, 0, 0, 0), (0, 1, 1, 0), 
and (0,0,0, 1). Let (/? : — )■ be the embedding given by right multiplication by the matrix 




G GL4(Z) 



Then (p*Po has vertices (—1,1,0), (1,1,1), (0,0,-1), and (0,0,0), with normal form given by 
(0,0,0), (1,0,0), (0,1,0), and (1,1,2). Hence NF(P) corresponds to the vertices (0,1,0,0), 
(0, 0, 1, 0), and (0, 1, 1, 2). In fact P is isomorphic to NF(P) via the change of basis 

/ 1 1 \ 
1111 
-10 
\0 -1 -1 -2J 

3.3. AfRne normal form. The normal form can be adapted to give an affine normal form 
AfFNF(P) such that AffNF(P) = AfrNF(P') if and only if polytopes P and P' are equivalent. 
One could simply define 

AffNF(P) := min{NF(P - v) \ v £ V(P)} . 

However, since the relative height of a vertex over a facet is unchanged by lattice translation, 
we have that PM™*^^ is invariant. Hence 

AfrNF(P) = mm{H{a o a^m^Ay - v)) \ a G Aut ( PM'^^^ ), ^; G V(P)} . 

Example 3.7. Returning to the polytope in Example |3.4| we obtain 

/O 1 3 2 1^ 
AfrNF(P) = 1 2 1 2 
\0 1 -1 Oy 

3.4. The Palp normal form. Kreuzer and Skarke's Palp normal form applies an additional 
modification to the order of the columns of the maximum vertex-facet pairing matrix PM™^^. 
For any nj x riy matrix M, let cmU) ■= max{Mjj \ 1 < i < rif}, and smU) ■= Yli=i ^iji where 
1 < J ^ n^- The following pseudo-code describes how the columns of PM™'^^ (or, equivalently, 
the vertices of P) are rearranged. 

M ^ PM'^'''' 
for i = 1 to riy do 
■(— i 

for j = i -|- 1 to n„ do 

if CM(j) < CM{k) V (cM(j) = CM{k) A smU) < SM{k)) then 

end if 
end for 

M ^ SwapColumn(M, i, k) 
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end for 



Example 3.8. We revisit Example 3.4 In this case, PM™**^ is modified by applying the 
permutation (1 6 3 2) (4 7) to the columns, giving 
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2 
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1 
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1 
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3 
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2 
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2 


2 





V 



The resulting Palp normal form corresponds to the sequence of vertices (1,0,0), (0,1,0), 
(0,-1,0), (-1,0,0), (0,0,1), (1,1,0), and (0,-1,-1). 



Example 3.9. The affine normal form for the polytope in Example 3.4 with modified PM"^ 
is given by 

/O 1 1 2 2 
AffNF(P) = 00220 -1 3 
VO 1 -ly 

4. Exploiting the automorphism group of the pairing matrix 

A crucial part of the normal form algorithm described in ^is the ability to efficiently calculate 
the maximum vertex-facet pairing matrix PM^^^. One also needs to know a permutation a such 
that aPM = PM^^"^, and to be able to calculate Aut(PM™'*'^). These data can be constructed 
as PM™^^ is calculated - this is the approach taken by the Palp source code described in 
Appendix |A] - or recovered later. This section focuses on this second approach. A detailed 
algorithm is given in Appendix [B} 

Consider a case when PM is very symmetric, so that the order of Aut(PM) is large (for exam- 
ple, the vertex-facet pairing matrix for the n-dimensional polytope associated with projective 
space has |Aut(PM)| = (n + 1)!). In such situations, the Palp algorithm is highly ineffi- 
cient. Whilst computing PM™*^^ the symmetries are not taken into account, so the algorithm 
needlessly explores equivalent permutations. Intuitively, one should be able to improve on the 
Palp algorithm by exploiting the automorphism group of PM. 

Given an rir x Uc matrix PM and a group of possible column permutations S (initially set to 
Sric), one can inductively convert this into PM^^^ as follows: 

(1) If n,. = 1 then PM°>^^ = max{o-PAf \ a £S}. 

(2) If IS"! = 1 then no permutations of the columns of PM are possible, and PM™^^ is given 
by sorting the rows of PM in decreasing order. 

(3) Suppose now that > 1 and \S\ > 1. 
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(a) Let i?™**^ := maxjcrPMj | cr G 5, 1 < i < n^} be the largest row in PM, up to the 
action of S. 

(b) Set y := {a G 5 I di?"^^^ = i?'"^^}. 

(c) For each row 1 < i < such that there exists a permutation a £ S with aPMi = 
^max^ consider the matrix M(j) obtained from aPM by deleting the i-th row. If 
M(j-) = M(j) for some j < i, then skip this case. Otherwise let M^-j^^ be the 
(rir — 1) xric matrix obtained by inductively applying this process with PM ^ ^^(i) 
and S ^ S'. 

(d) Set M'^'''' to be the maximum of all such M^™^'"''. Then 



^max 
^max 



4.1. Test case: the database of smooth Fano polytopes. The algorithm described in 
Appendix [B| which we shall hereafter refer to as Symm, was implemented by the authors and 



compared against the Palp algorithm. As Examples |4.1| and 4.2 illustrate, the difference in 
run-time between the two approaches can be considerable. 

Example 4.1. Let P be the six-dimensional polytop^with 14 vertices 

± (1, 0, 0, 0, 0, 0), ±(0, 1, 0, 0, 0, 0), ±(0, 0, 1, 0, 0, 0), ±(0, 0, 0, 1, 0, 0), 
± (0, 0, 0, 0, 1,0), ±(0, 0, 0, 0, 0, 1), ±(1, 1, 1, 1, 1, 1). 

The automorphism group Aut(PM) is of order 10,080. On our test machine the Palp algorithm 
took 512.88 seconds, whereas the Symm algorithm took only 5.83 seconds. 

Example 4.2. Let P be the six-dimensional polytop^with 12 vertices 

(1, 0, 0, 0, 0, 0), (0, 1, 0, 0, 0, 0), (0, 0, 1, 0, 0, 0), (0, 0, 0, 1, 0, 0), (0, 0, 0, 0, 1, 0), 
(0,0, 0,0, 0,1), (-1,-1, -1,1, 1,1), (0,0, 1,-1, 0,0), (0,0, -1,0, 0,0), 
(0, 1, 1, -1, -1, -1), (0, -1, -1, 0, 0, 0), (0, 0, 0, 0, -1, -1). 

The automorphism group Aut(PM) is of order 16; the Palp algorithm took 0.55 seconds whilst 
the Symm algorithm took 4.30 seconds. 

Table [2] contains timing data comparing the Palp algorithm with the Symm algorithm. 
This data was collected by sampling polytopes from 0bro's classification of smooth Fano poly- 
topes |0brO7 . For each smooth polytope P selected, the calculation was performed for both P 
and P* . In small dimensions the number of polytopes, and the time required for the computa- 
tions, is small enough that the entire classification can be used. It is important to emphasise 
that the smooth Fano polytopes are atypical in that they can be expected to have a large 
number of symmetries, and so favour Symm. Experimental evidence suggests that the ratio 

^Smooth Fano polytope number 1930 in the Graded Ring Database [BK| . 



^Smooth Fano polytope number 1854 in the Graded Ring Database [BK| 
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r := |Aut(PM)| jn^ is a good proxy for deciding between the two choices. When r < 1 the Palp 
algorithm often performs better, whereas larger values indicate Symm should be used. 

Palp Symm Best 



Dim. 




Total 


Average 


Total 


Average 


Total 


Average 


4 


248 


6.28 


0.03 


4.48 


0.02 


3.41 


0.01 


5 


1732 


98.30 


0.06 


59.53 


0.03 


46.17 


0.03 


6 


15244 


6148.45 


0.40 


1510.32 


0.10 


1214.25 


0.08 


7 


150892 


152279.91 


1.01 


45230.55 


0.30 


34818.32 


0.23 


8 


281629 


611795.13 


2.17 


152902.73 


0.54 


111426.70 


0.40 



Table 2. Timing data, in seconds, for the Palp algorithm and for the Symm 
algorithm. The best possible time if one could infallibly choose the faster of the 
two algorithms is recorded by Best. 



5. Applications to Laurent polynomials 

Let / G C[ Laurent polynomial in n variables, and let P := Newt(/) 

denote the Newton polytope of /. We require throughout that dimP = n, i.e. that P is 
of maximum dimension in the ambient lattice. An element B € GL„(Z) corresponds to the 
invertible monomial transformation 

(^B:(c*r^(c*r 

J 1 ^ ' 

and g = ip*^f is also a Laurent polynomial. In particular, Newt(gf) = P ■ B. 

As when working with lattice polytopes, it can be advantageous to be able to present / in a 



normal form with respect to transformations of type (5.1) 



Definition 5.1. Given two Laurent polynomials / and g such that Newt(/) = Newt(g'), we 
define an order ^ on / and g as follows. Let vi < V2 < ■ ■ ■ < Vk he the lattice points in Newt(/), 
listed in lexicographic order. To each point Vi there exists a (possibly zero) coefficient q of x^^ 
in /, and coefficient di in g. Define coeffs(/) := (ci,C2, . . . ,Cfc). We write / ^ if and only if 
coeffs(/) < coeSs{g). 

Remark 5.2. Any Laurent polynomial / determines a pair (coeffs(/), Newt(/)). Conversely, 
given any pair (c, P), where c G C'^ and P C Aq is a maximum-dimensional lattice polytope 
such that k = |P H A|, we can associate a Laurent polynomial. If we insist that the q associated 
with the vertices V{P) are non-zero then we have a one-to-one correspondence. 

Definition 5.3. Let / be a Laurent polynomial, and set P := Newt(/). Let B G GL„(Z) be 
such that P ■ B = NF(P). The normal form for / is 

NF(/) := min^ {ipA o ipsif) \ A G Aut(NF(P))} . 
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Example 5.4. Consider the Laurent polynomial 



2 1 3 



/ = 2x'y + - + 

X xy 

Then NF(P) has vertices (1,0), (0, 1), and (—1, —1), with corresponding transformation matrix 



Under this transformation, 



2 

^*Bf = 3x + y H 

xy 



and coeffs(99^/) = (2,0,1,3). The automorphism group Aut(NF(P)) = 5*3 acts by permuting 
the non-zero elements in the coefficient vector, hence 

NF(/) = 3x + 2i/ + — . 

xy 

A naive implementation of Laurent normal form faces a serious problem: listing the points 
in a polytope is computationally expensive, and will often be the slowest part of the algorithm 
by many orders of magnitude. With a little care this can be avoided. What is really needed 
in Definition 5.3 is not the entire coefficient vector, but the closure of the non-zero coefficients 
under the action of Aut(NF(P)). We illustrate this observation with an example. 

Example 5.5. Consider the Laurent polynomial 

„30^30 ^10 „,40^20 ,,40 i i 

f ^ 50 50 , 50 30 , ^ ^ , ^ , , V ^ , Ji , ^ , ^ 

J j^y^-TJ^y-r^^g-r ^40^20 ^ ^ ^ ^10 ^ Z^^ j;50y30 ^ 3.50y50;250 ' 

Set P = Newt(/). Notice that |P n A| = 285241; enumerating the points in P is clearly not the 
correct approach. The normal form NF(P) is given by change of basis 

/-3 -4 ~6\ 
B = \ 5 7 10 I e GL3(Z) 

with 

g := = ^650^880^1270 ^ ^500^650^950 + ^10 + ylO+ JL + 

yW 

1 1 1 

+ .n in + .nn ..n n.n + 




^10 ' 2;10yl32l9 3.500^650^950 ' 2;650y8802l270 ' 

The automorphism group G := Aut(NF(P)) is of order two, generated by the involution u i— )• —u. 
We consider the closure of the nine lattice points corresponding to the exponents of g under 
the action of G. The only additional point is (10, 13, 19). Thus we can express coeSs{g) with 
respect to these ten points: 

coeffs(5) = (1,1,1,1,1,1,1,0,1,1). 

The key observation is that the action of G on (7 will not introduce any additional points, hence 
the lexicographically smallest coefficient sequence with respect to these points will also be the 
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smallest coefficient sequence with respect to all the points of NF(P). By applying the involution 
we obtain the smaller coefficient sequence (1,1,0, 1,1, 1,1, 1,1,1), hence 

NF(/) = x65°/80^1270 ^ ^500^650^950 ^ ^10^13^19^^10 ^ ^10^ 

111 1 

1 e:r\r\ £ir:n nr:n 



ylO ' J.W ' 2;500y650;2950 ' 3,650^88021270 ' 



We conclude this section by remarking that the automorphism group Aut(/) < GL„(Z) of 
a Laurent polynomial / can easily be constructed from Aut(Newt(/)) by restricting to the 
subgroup that leaves coeffs(/) invariant. 



Appendix A. The Kreuzer-Skarke algorithm 

We describe in detail the algorithm used by Kreuzer and Skarke in Palp |KS04j to compute 
the normal form of a lattice polytope P of maximum dimension n. Any such polytope can be 
represented by a n x n^, matrix V whose columns correspond to the vertices of P. This matrix 
is unique up to permutation of columns and the action of GL„(Z); i.e. one can change the order 
of the vertices and the underlying basis for the lattice to obtain a different matrix V' . 

The Palp normal form is a unique representation of the polytope P such that if Q is any 
other maximum dimensional lattice polytope, then P and Q are isomorphic if and only if their 
normal forms are equal. For any matrix V with integer entries, and any G G GL„(Z), the 
Hermite normal form of G • ^ is uniquely defined. The question is how to define a canonical 
order for the vertices, since permuting the vertices will lead to a different Hermite normal form. 

In what follows, the line numbers refer to the Palp source ffie Polynf . We have chosen 
our notation to correspond as closely as possible to the source code. The algorithm will be 
described in eight stages: 

lA.ll The pairing matrix; 

IA.2I The maximal pairing matrix; 

IA.31 Constructing the ffist row; 

IA.4I Computing the restricted automorphism group, step I; 

IA.5I Constructing the A;-th row; 

IA.61 Updating the set of permutations; 

IA.71 Computing the restricted automorphism group, step II; 
IA.8I Computing the normal form of the polytope. 

A.l. The pairing matrix. We start by constructing the pairing matrix PM. 



Line: 197 (Init_rVM_VPM) 
Input: A list of vertices and a list of equations for the supporting hyperplanes. 
Output: The pairing matrix PM. 



^Palp 1.1, updated November 2, 2006. 



http : //hep . itp . tuwien . ac . at/~kreuzer/CY/palp/palp-l . 1 . tair .gz 
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Let {vi}^^^ be the vertices of P, in some order, and '^ij^j + Q = 0, i = 1, . . . ,n/, be 

the equations of the supporting hyperplanes of P. Here Uv is equal to the number of vertices of 
P, and Uf is equal to the number of facets of P. The wi are the inward-pointing primitive facet 
normals, and the Cj are necessarily integers. The pairing matrix PM is the Uf x Uy matrix 

n 

PMij = ^ WikVjk + Ci = {wi, Vj) + Ci 
k=l 

with integral coefficients. 

The order of the columns of PM corresponds to an order of the vertices of P, and the order 
of the rows of PM corresponds to an order of the facets of P. Let p = (r, c) G Snj x Sn^ act on 
PM via 

A. 2. The maximal pairing matrix. Let PM™^^ denote the maximal lexicographic matrix 
(when reading row by row) obtained from PM by reordering rows and columns, so that 

PM""^ := max {pPM | p G x 5„ J . 

It can happen that Aut(PM) < Sn^ x Sn^ is non-trivial, say |Aut(PM)| = n^. Then we have 
Us permutations {pi}^li such that piPM = PM™^^, and Ug corresponding orders for the vertices 
of the polytope. Our main task is to compute PiVP^^ and {pj}"^^ from PM. This will be done 
by induction on the rows of PM™^. 

A. 3. Constructing the first row. We begin by constructing the first row of PM™^. 



Line: 348 (Aux_vNF_Line) 
Input: The paring matrix PM. 
Output: An array of permutations giving the first row of PM™^^. 

Set Ug = 1 and maximise the first row of PM, i.e. find a permutation ci G Sn^ such that 
PMi,,(,) <PMi,,(,),i <i: 

(ri,ci) ^ (l5„^,ls„J 
for j = 1 to riy do 

m ^ IndexOfMaxiPMii \i> j} 

if m > 1 then 

ci ^ ci{jm + j - 1) 

end if 
end for 
b^PMi 

Suppose we have computed the first A; — 1 lines, Ug of which could be chosen to be the first 
row of PM™^ (i.e. up to reordering of the facets they are maximal among other lines and equal 
to the reference line, denoted b). Then we have integers l<ki<k— l<nf with corresponding 



18 



R. GRINIS AND A. M. KASPRZYK 



permutations pi = {ri,Ci) G Snf x Sn^, i = 1, . . . , ra^, and a reference line defined by 6 := PM^^ 
such that: 

P^hcij) = K{j)^ i = l,...,ns,j = l,...,nv. 
Set ri = (Iki) to be the permutation which moves the line in question to the first row of PM. 
Now we consider the fc-th row of PM. Find the maximal element maxj{PMfej}, say PM^m, 
and let Cn^+i = (Im). We compare this against the reference line. If PMi^^ns+iW ^ ^ci(i) then 
continue with the next line (or stop if we are at the last line), otherwise continue constructing 
Cn,+i. If maxj>i{PMfcc„^^i(j)} = PMkc„^^-^(m) then let Cn,+i i-> c„^+i(2m) and verify that 
PM^(,„3+i{2) < ^ci{2)j if this inequality fails to hold then continue with the next element. 

If the line k is not less than the reference line b then we set rn^+i = (1 k) and have two cases 
to consider: 

(1) If i-*M^c„^+i(j) = ^ci(j)) j = ^, ■ ■ ■ ,ny, then we have a new case of symmetry. We set 
kjis+i '■= k and increment the number of symmetries Hg. 

(2) Otherwise we have found a (lexicographically) bigger row and so obtain a new reference 
line. We set b := PM^, ki := k, and pi := (r„^+i, c„^+i), and reset the number of 
symmetries Ug. 

for k = 2 to Uf do 

{rns+l,Cns+l) ^ (l5„^.,l5„„) 

m ^ IndexOfMax{PMfec„^+i(j) | j > l} 
if m > 1 then 

C„,+l ^ Cn,+l(lm) 

end if 

if d < then 
continue 
end if 

for i = 2 to rit, do 

m IndexOfMax{PM;i.c„^+i(i) I J > ^} 
if m > 1 then 

Cns+l ^ Cn,+i{im + i- 1) 
end if 
if d=0 then 

d ^ PMkc„^^^^{) - 6ci(i) 
if d < then 

break 
end if 
end if 
end for 
if d < then 
continue 
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end if 

if d = then 

ns ns + 1 
else 

(ri,ci) ^ (r-n,+l,Cn,+l) 

Us ^ 1 

end if 
end for 

A. 4. Computing the restricted automorphism group, step I. Once the first row of 
PM^^ has been constructed, it imposes restrictions on any future column permutations: they 
must fix the first row. 

Line: 376 (Aux_vNF_Line) 
Input: The first hne of the maximal pairing matrix. 
Output: The array S capturing its automorphism group. 

Suppose that the row is equal to blocks of aj's, each of size rii , i = 1, . . . , k, where Yli=i "^i — 

ai ... ai I 02 ... a2 I . . . I afe ... ^ . 

It is clear that if we had such a row, the only permutations of columns allowed in the con- 
struction of later rows will be those factoring through 5*,^ x x . . . x Sn^ ■ The symmetry 
of this row is encoded in an array S such that if S{i) = j and S{S{i)) = S{j) = h then the 
index i is in the block delimited by the indices j and h (depending on whichever is greater) . We 
represent S as an array 

ni 1 ... 1 I ni + 712 7^1 + 1 • • . 7ii + 1 I . . . 

\nv 1 + Eti'^i ••• 1 + Ef=i«0 

Example A.l. The symmetries of the row (5 55543322210 0) are encoded by the array 

5=^4 1 1 l|5|7 6|l0 8 8|ll|l3 12 ). 

When S = (12 ... n^) the columns are fixed and we may only permute the rows. The 
computation of S is summarised in the following pseudo-code: 
S" ^ (1 2 ... n^) 
for i = 2 to 71^, do 

if PM^^(i)ci(i_i) = PM^^(i)ci(i) then 
S{i) ^ S{i - 1) 
S^{i) ^ S{S{i)) + 1 
else 
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S{t) ^ i 
end if 
end for 

A. 5. Constructing the k-th row. Proceeding by induction on tiie rows, we construct tlie 

remaining rows of PAI"^'^^. 



Line: 289 (Aux_vNF_Line) 
Input: PM, the permutations {pi}^li, and the array 5'. 
Output: The A;-th hne of the maximal pairing matrix. 

Assume wc have computed the first / — 1 < Uf — l rows of PAf™^^ and the associated symmetry 
array S (notice that the last row of PAf "'^^ need not be computed as it is completely determined) , 
together with Ug distinct permutations pi = {ri,Ci) G Snj x Sn^ such that 

p^max ^ PM,^(fc),^(^) for all 1 < J < n^, 1 < A: < 1, 1 < i < n,. 

We have to consider each configuration given by the permutations {pi}^l^. For each configu- 
ration we generally obtain Up ways to construct the line /, moreover some constructions might 
give a smaller line, hence Ug will have to be updated as we proceed. Let hg record the initial 
value of Ug- 

First consider the case k = hs. We will construct a candidate line for the Z-th row of PM™^; 
this will be our reference line against which the other cases will be compared. If a greater 
candidate is found, all the preceding computations will have to be deleted and redone with the 
new candidate. If a given case lead to a smaller line than the reference, it will have to be deleted. 

Initially set the local number of symmetries, Up, to zero and initialise the permutation = 
Pk- We start with the line fnp{l) by finding the maximal element of the first symmetry block. 
Suppose that 

max{PM,.,^^(;)e„^(,) I 1 < i < 5(1)} = PM,-„^(i)g^^(„). 

Then we update c^^ to c^^ (Im). This maximal value is saved in the reference line which we 
denote Ir (if it were already constructed, k < hg, we move straight to the tests below). We 
increment Up by one to reflect this new candidate, initialise pnp = Pk, and proceed to consider 
the maximal entries in the first symmetry block for other lines rk{s), s = I + 1, . . . ,nf. 

Inductively, suppose we have considered s — 1 lines where Hp of them have a maximal element 
in the first symmetry block equal to the one of the reference line Zr(l), and the others have 
smaller values. Wc also have f^^ = from the initialisation. Consider the line f„p(s) and find 
its maximal element in 1, . . . ,S'(1) as above, updating c^^. Now if PM^^^^^^g^^j-x) < ^r(l) then 
proceed to the case s + 1, if possible. Otherwise f„p i— )■ {I s) and there are two possibilities: 
if PMf:^^(^)c„p(i) = ^r(l) then increase the number of symmetries i— )■ + 1 and move to 1, 
after initialising the new permutation p^ = Pk; if PMj;^ > lr{l) then redefine the 

first element of the reference line Zr-(l) ■= -P-^r„p {s)c„p (i) ) update the first permutation po = Pup, 
and reset Up = 1 ready for the next permutation pn^ = pk- 
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1 

np <(- 
ccf cf 

{rnp,Cnp) ^ {rk,Ck) 

for s = I to Uf do 

for j = 2 to 5(1) do 

if ™f (c) < PM,-„^(,)£„^(,) then 

end if 
end for 
if ccf = then 

■Trip ^ rnp{ls) 
Up ^ Up + l 

ccf ^ 1 

else 

if d < then 
continue 
else if d = then 

np ^ Up + 1 

{fnp,Cnp) ^ {rk,Ck) 

else 

(fi,Ci) 4- {fnp,Cnp) 
Hp^l 

{rnp,Cnp) ^ {rk,Ck) 

Us k 
rnp ^ rnp{ls) 
end if 
end if 
end for 

Note that the initial value of the com^parison flag cf is 0. This indicates that the reference 
line has not been initialised; it is also reset to zero when a greater candidate is found. We will 
see later how cf is updated. 

We need to construct other elements of Ir- Inductively, suppose we are constructing the entry i 
of Ir and we have Up symmetries with corresponding permutations pj, j = 0, . . . ,np — l. If = 
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we move to the next configuration k — 1 after fiaving updated the symmetries accordingly, i.e. we 
do not save the current configuration. Otherwise, start with the last j = Up — 1. Determine 
where the corresponding block of symmetry ends for i by looking at the maximum of S{i) and 
S'^{i), which we will call h. Then compute 

max |pMj;^.(i)a^.(A) M < A < /i} = PMf.^^^.^^) 

and update cj i-> Cj (im) . This value is saved in the reference line lr{i)- Then we consider 
(inductively) any cases of symmetry with j < Up — 1 and compute the i-th entry in the same 
manner as above: if PMf.^i-^g.^j^ = then continue with the next j; if PMf.^j^^.^j^ < then 
the current case is removed and we update Up ^ Up — 1; finally if PMf.fj^^^.fj^^ > Irii) then all 
cases previously considered are irrelevant, so we let Up = j + 1 and the reference line is updated 

lr{i) = PMf^(i)^^(iy 

for c = 2 to n„ do 
h ^ 5(c) 
ccf c/ 
if /i < c then 
h ^ S{h) 
end if 

s ^ Up 

while s > do 

s ^ s - 1 

for j = c+lto h do 

if PMf^dY^^^^^ < PM^-^(;)a,Q) then 

Cs ^ Cs{cj) 

end if 
end for 
if ccf = then 

ccf ^ 1 
else 

d ^ PMf^(^i)c,(c) - ^r(c) 

if d < then 

rip i~ Up-l 
if rip > s then 

(r,,5s) ^ {rnp,Cnp) 

end if 
else if d > then 

lr{c) ^ PMf^^iy^^^^^ 

cf^O 

Up s + 1 
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Us ^ k 
end if 
end if 
end while 
end for 

A. 6. Updating the set of permutations. The last step in the construction of the hne I is to 
organise the new symmetries for a given case A;. 



Line: 333 (Aux_vNF_Line) 
Input: The permutations {piYlli and the newly computed 
Output: The updated set {pi}^!^- 



Recall that rig denotes the number of symmetries we had before performing the computations 
for the line I of PM™^, and Ug < fig represents the updated number symmetries. Our current 
construction of the line I may well introduce new symmetries, so-called local symmetries, of 
which there are Up. We can have Up = 0, in which case all the configurations in the case k 
lead to a smaller candidate for /. When > the local symmetries are represented by the set 
{Pi}"=o ^ permutations. 

We now update the array of all permutations. If > A; we set pk = Pns\ we want the set of 
permutations {pi}"^^ to be updated so that the only cases which need to be considered are those 
with index i < k. Since we are appending Up new permutations at end for the indices i > Ug, 
so ris — > ris + Up — 1. If np = then nothing is appended and Ug decreases by one as required. 
Finally, we update the comparison flag cf to reflect the current number of symmetries. 

TT-s — 1 

if > A: — 1 then 

end if 

cf ns + Up 

for s = to rip — 1 do 

K.+l,Cn,+l) ^ {fg,Cg) 
7T,s ns + 1 

end for 

A. 7. Computing the restricted automorphism group, step II. Once a new row of PM™^ 
has been compute we need to update S to reflect the symmetries of this row. This is done by 
restricting the blocks previously delimited by S to reflect any additional constraints imposed by 
the row. 
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Example A. 2. Continuing Example |A.l suppose that the second row of the candidate PM^ 
has been computed, and that the two rows are given by 



5555433222100 
4333322210000 



The corresponding array S is 



1 4 2 2 5 7 6 8 9 10 11 13 12 



Line: 376 (Aux_vNF_Line) 
Input: The newly computed upper block of the maximal pairing matrix. 
Output: The updated array S capturing the automorphism group of the matrix. 



1 

while c < n^, + 1 do 
s ^ 5(c) + 1 
5(c) ^ c 
c c + 1 
while c < s do 

if PMr^^i)^^^^) = PM^^(i)c,(c-i) then 
5(c) ^ 5(c- 1) 
52(c) ^ 52(c) + 1 
else 

5(c) ^ c 
end if 
c ^ c + 1 
end while 
end while 

A. 8. Computing the normal form of the polytope. Inductively, we have obtained 
permutations {pi = (fi, Ci)}^^^ such that piPM = PM"^^^. We are really only interested in the 
permutations of the columns, since they correspond to permutations of the vertices of P. The 
Palp algorithm computes a new order for the columns of PM™**^ based on the following: the 
maximum coefficient in the column; the sum of the coefficients in the column; and the relative 
position of the column in PM"^^^. Let pc G Sn^ denote this column permutation. 



Line: 216 (New_pNF_Order) 
Input: The maximal pairing matrix PM 
Output: The column permutation pc G 5^ 
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Pc ^ 1S„„ 

^max ^ |maxi<,<„^^ [PM^''^ I 1 < J < n^} 

^max ^ 1^^^^^^^ PM^- I 1 < j < n,} 

for i = 1 to do 

k -(^ i 

for j = i + 1 to riv do 

if {M^^ < M™^) V ((Mj^^ = M^^) A {Sf^ < S^^)) then 

A; ^ j 
end if 
end for 
if A: 7^ i then 

^ SwapRow(M'^^^, i, k) 
S^^ ^ SwapRow(S"^^, i, k) 
Pc ^ Pc{i k) 
end if 
end for 

Given the column permutations pc and q, i = l...,ns, we obtain a permutation of the 
vertices of P, and hence of the columns of the vertex matrix V. We let Vi denote this reordered 
vertex matrix. The remaining freedom - the action of GL„(Z) corresponding to the choice of 
lattice basis - is removed by computing the Hermite normal form HiVi). 



Line: 134 (GLZJ1ake_Triaii_NF) 
Input: A matrix with integer coefficents. 
Output: The Hermite normal form of the matrix. 

The Palp normal form is simply the minimum amongst the H{Vi). 



Line: 399 (Aux_Make_Triang) 
Input: The column permutations pc and {ci}^^^, and the vertex matrix V. 
Output: The normal form. 



Appendix B. Calculating the maximum pairing matrix 

Let M be an x ric matrix. Recall that we define an action of = (ar, cJc) G Sn^ x on 
the rows and columns of M via {aM)ij := M^-^^j) (^^(j), and that we call two matrices M and M' 
isomorphic if there exists some permutation a G >S„^ x Sn^ such that a{M) = M' . We begin by 
briefly describing one approach to determining when two matrices are isomorphic. 

Given a matrix M, we associate a bipartite graph G{M) with + ric vertices, where the 
vertices Vi, Vn^+j are connected by an edge Eij for all 1 < i < n^, I < j < ric- Each edge 
Eij is labelled with the corresponding value Mij. The vertices Vi, 1 < i < rir, are labelled 
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with one colour, whilst the vertices Vn^+j, 1 < j < nc, are labelled with a second colour. This 
distinguishes between vertices representing rows of M and vertices representing columns of M. 
Clearly two matrices M and M' are isomorphic if and only if the graphs G{M) and G{M') are 
isomorphic. We note also that the automorphism group Aut(M) < x is given by the 
automorphism group of G(M). 

We now describe a recTirsivc algorithm to compute PM™^^ from PM. For readability, we shall 
split this algorithm into three parts, with a brief discussion preceding each part. 



Input: A matrix PM. 
Output: The maximal matrix PM' 



Throughout we set rir and ric equal to, respectively, the number of rows and the number of 
columns of the input matrix PM. A vector s of length ric is used to represent the permitted 
permutations of the columns of PM. Initially s is defined as 

s = (a,...,a) G 

where a := 1 + max PMjj is larger than any entry of the matrix PM. At each step of the 
recursion, the value of Uc remains unchanged, but the value of will decrease by one as a row 
of PM is removed from consideration. The vector s will be modified to reflect the symmetries of 
the previously steps; two coefficients Sj and Sk are equal if and only if the columns j and k can 
be exchanged without affecting the computations so far. By construction s will always satisfy: 

(1) either Sj = Sj+i or Sj = Sj+i + 1, for each 1 < j < ric, 

(2) Sn, = a. 

The first stage is to calculate the maximum possible row p™^^ of PM, where each row is 
sorted in decreasing order. Once done, we update the vector s to reflect the possible column 
permutations that will leave p™**^ unchanged. 

Ri ^ Sort>{(sj, PMij) I 1 < i < nj 

Ri ^ {Rij2 I 1 < i < nc) 

^max ^ max{Pi I 1 < i < n^} 

s' s 

for j = nc — 1 to 1 by —1 do 

if Sj = Sj+i A P"^^^ P™pf then 
for A; = 1 to J do 

^'k ^ «fe + 1 
end for 

end if 

end for 

Next we collect together all non-isomorphic ways of writing PM with R^^ as the flrst row. 
These possibilities are recorded in the set M.. 
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for i = 1 to rir such that Ri = i?™ax 
M ^ SwapRow(PM, 
T ^ Sort>{(sj, My, j) I 1 < j < ne} 
r permutation in Sn^ sending j to Tj^ 
M ^ t{M) 
M ^ M 
Ml ^ s' 

if Am'^M (^^' ^ ^) then 

M^MU {M} 
end if 
end for 

When all possible symmetries of the columns have been exhausted, the vector s' will be equal 
to the sequence 

(a + He — I, a + ric — 2, . . . ,a). 

If this is the case, then PM™^^ is the maximum matrix in A4, once the rows have been placed in 
decreasing order. If there remain symmetries to explore, then we recurse on each of the matrices 
in Ai using the new permutation vector s'; PM^^^ is given by the largest resulting matrix. 

if = 1 then 

else if s'l = s'^^ + ric — 1 then 

p^^max ^ max{SortRows>(M) \ M £ M} 
else 

M' ^{} 

for M e M do 

M' ^ RemoveRow(M, 1) 
M' ^ (recurse with PM ^ M' and s ^ s') 
M' ^M'U {M'} 
end for 

p^max ^ VerticalJoin(i?'^'^'^^,maxA^') 
end if 
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